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The  Honorable  Dale  Bumpers 
United  States  Senate 

Dear  Senator  Bumpers: 

In  response  to  your  request  of  February  24. 1997,  we  reviewed  the  Air 
Force  s  February  1997  plans  to  restructure  the  F-22  program.  This  report 
presents  our  observations  regarding  the  estimated  cost  of  the  restructured 
program  and  viability  of  cost  reduction  initiatives,  planned  timing  for 
realization  of  benefits  from  initiatives,  and  criteria  for  approving  initiation 
and  continuation  of  production. 

An  important  factor  that  will  significantly  impact  the  cost  of  the 
restructured  program,  and  the  viability  of  cost  reduction  initiatives 
discussed  in  this  report  is  the  Quadrennial  Defense  Review,  which  was 
released  in  mid-May.  This  review  calls  for  reductions  in  the  F-22  low-rate 
initial  production  (lrip)  quantity,  the  total  production  quantity,  and  the 
production  rates.  Because  the  production  quantities  and  rates  were  basic 
assumptions  guiding  the  February  1997  F-22  restructuring  plan,  changes  in 
the  F-22  program  that  result  from  the  review  will  require  reevaluation  of 
the  cost  of  the  program,  the  potential  for  cost  reductions,  and  the  contract 
strategy.  Nevertheless,  the  information  in  this  report  provides  an 
important  historical  and  contextual  framework  for  decisionmakers  as  they 
debate  the  issues  surrounding  the  F-22. 


Background 


The  F-22  is  an  air  superiority  aircraft  with  a  capability  to  deliver 
air-to-ground  weapons.  Advanced  technology  being  developed  for  the  F-22 
makes  it "...  a  very  ambitious,  challenging  program,  probably  the  most 
challenging  program  in  recent  times,”  according  to  the  Department  of 
Defense’s  (dod)  Defense  Science  Board.  The  most  significant  features 
include  supercruise,  the  ability  to  fly  efficiently  at  supersonic  speeds 
without  using  fuel-consuming  afterburners:  low  observability  to  adversary 
systems  that  have  the  objective  of  locating  and  shooting  the  F-22:  and 
integrated  avionics  to  significantly  improve  the  pilot’s  battlefield 
awareness. 

The  F-22  program  began  the  engineering  and  manufacturing  development 
phase  of  the  acquisition  process  in  1991.  According  to  the  fiscal  year  1997 
President’s  budget,  the  Air  Force  planned  to  develop  the  F-22  and  build 
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nine  development  aircraft,  two  nonflying  structural  test  articles,  and  four 
preproduction  aircraft  at  a  cost  of  about  $17.4  billion.  The  Air  Force 
planned  to  buy  76  aircraft  during  the  LRIP  phase  of  the  program  and  362 
aircraft  during  the  full-rate  production  phase.  The  total  estimated 
production  cost  was  about  $48  billion. 

The  Assistant  Secretary  of  the  Air  Force  for  Acquisition  engaged  a  Joint 
Estimate  Team  (jet)  because  management  reviews  of  the  F-22  program 
indicated  potential  cost  growth.  In  February  1997,  the  Under  Secretary  of 
Defense  for  Acquisition  and  Technology  approved  the  Air  Force’s 
proposed  plan  to  restructure  the  F-22  program  based  on  the  results  of  the 
jet’s  review,  jet  concluded  that  the  F-22  engineering  and  manufacturing 
development  program  would  require  additional  time  and  funding  to  reduce 
risk  before  the  F-22  enters  production,  jet  estimated  that  the  development 
cost  would  increase  by  about  $1.45  billion.*  Also,  jet  concluded  that  F-22 
production  cost  could  grow  by  about  $13  billion  (from  $48  billion  to 
$61  billion)  unless  offset  by  various  cost  avoidance  actions,  identified  as 
tier  I  and  tier  II  initiatives.  These  initiatives  are  being  further  defined  by  a 
study  team  chartered  by  the  Assistant  Secretary  of  the  Air  Force  for 
Acquisition.  That  team  is  scheduled  to  report  its  conclusions  in  the  fall  of 
1997.  We  have  not  reviewed  the  basis  for  the  revised  savings  estimates  that 
are  now  being  devised  by  the  team. 

We  have  issued  a  number  of  reports  concerning  the  F-22  fighter  program. 
(See  Related  GAO  Products  at  the  end  of  this  report.)  In  an  April  1995 
report,^  we  recommended  that  the  Secretary  of  Defense  reduce  the  degree 
of  concurrency  between  development  and  production  of  the  F-22  and 
minimize  commitments  to  production  until  after  successful  completion  of 
operational  testing. 


Results  in  Brief 


Our  reviews  of  various  weapon  system  acquisitions  have  shown  that  initial 
program  schedules  and  cost  estimates  have  historically  been  optimistic 
and  have  not  often  been  achieved.  The  F-22  program  is  not  an  exception. 
Further,  we  believe  the  February  1997  restructuring  plan  reflects  revised 
cost  goals  that  may  be  optimistic  because  (1)  the  planned  reductions  in 
F-22  production  unit  costs  are  greater  than  those  experienced  by  prior 


UET  estimated  the  increase  at  $2.2  billion;  however,  a  decision  to  delete  preproduction  aircraft, 
estimated  to  cost  $706  million,  reduced  the  estimated  development  cost  increase  to  $1,45  billion. 

^Tactical  Aircraft:  Concurrency  in  Development  and  Production  of  F-22  Aircraft  Should  Be  Reduced 
(GAO/NSIAD-95-59,  Apr.  19, 1993J: 
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fighter  programs  and  (2)  actions  intended  to  reduce  production  costs  have 
not  been  fully  defined  and  validated. 

Our  comparison  of  the  projected  reduction  in  F-22  production  unit  costs 
with  the  historical  unit  costs  of  the  F-15,  F-16,  and  F-18  programs  indicates 
that  the  F-22  reductions  exceed  those  that  have  been  achieved  on  these 
other  programs.  Also,  to  achieve  the  overall  cost  avoidance  projected  by 
the  Joint  Estimate  Team,  the  unit  cost  of  full-rate  aircraft  must  be  reduced 
by  54  percent  from  the  unit  cost  of  the  low-rate  initial  production  aircraft 
instead  of  by  27.9  percent,  as  projected  before  the  program  restructure. 
Further,  although  the  Air  Force  and  DOD  agree  that  unit  production  costs 
will  increase  through  2003,  DOD  was  not  convinced  that  the  substantial 
manufacturing  cost  savings  projected  by  the  Air  Force  for  fiscal  year  2004 
and  beyond  would  be  achieved.  Considerably  more  information  about  the 
initiatives  and  their  incorporation  into  a  production  contract  is  necessary 
before  it  can  be  determined  that  they  will  produce  the  desired  outcome. 

An  aspect  of  cost  reduction  that  has  been  previously  reviewed  and  should 
continue  to  be  considered  is  the  potential  savings  from  reducing  F-22 
performance  requirements.  Joint  Estimate  Team  members  told  us  that, 
although  they  considered  performance  reductions  in  the  study  as  a  means 
of  reducing  costs,  and  that  potential  reductions  had  been  considered  in  at 
least  a  dozen  past  reviews,  no  performance  reductions  were  made  as  a 
result  of  their  study.  The  Defense  Science  Board  indicated  in  1995  that  the 
Air  Force  should  seriously  consider  reducing  F-22  performance 
requirements  to  resolve  problems  that  occur  in  the  program,  noting  that 
rigid  adherence  to  specifications  would  generally  be  unproductive  and 
very  costly. 

The  cost  reduction  initiatives  are  not  planned  to  achieve  significant  net 
savings  until  F-22  full-rate  production,  now  planned  to  begin  in  fiscal  year 
2004.  The  F-22  cost  estimate  developed  by  the  Joint  Estimate  Team  and 
endorsed  by  the  Air  Force  recognizes  unit  cost  increases  of  40  percent  in 
F-22  low-rate  initial  production  aircraft  through  fiscal  year  2003.  The 
increases  reflect  cost  growth  in  manufacturing  F-22s  and  the  cost  of 
funding  projects  during  low-rate  initial  production  to  achieve  future  cost 
reductions.  The  cost  estimate  projects  substantial  program  efficiencies 
that  offset  the  cost  growth  during  low-rate  initial  production  and  achieve 
reductions  in  unit  production  costs  only  after  the  F-22  is  in  full-rate 
production.  Thus,  achieving  the  cost  reductions,  and  closely  monitoring 
them  are  essential  to  defining  an  F-22  funding  profile  for  fiscal  year  2004 


Page  3 


GAO/NSIAD-97-156  F-22  Restructuring 


and  beyond  (full-rate  production)  that  meets  the  Air  Force’s  cost 
objectives. 

The  program  exit  criteria  that  were  required  before  awarding  each  lot  of 
low-rate  initial  production  aircraft  and  the  first  full-rate  production 
contract  have  been  revised  as  part  of  the  program  restructuring.^  Some 
key  measures  concerning  avionics  were  added;  however,  the  elements  of 
exit  criteria  concerning  aircraft  performance — including  maneuverability, 
combat  radius,  and  supercruise — that  were  previously  considered  exit 
criteria  for  moving  to  each  subsequent  low-rate  initial  production  lot  have 
been  deferred  until  the  beginning  of  full-rate  production.  Although  aircraft 
performance  parameters  are  reported  in  the  Selected  Acquisition  Report 
and  other  Air  Force  and  DOD  reports,  we  believe  specific  aircraft 
performance  parameters  should  be  included  in  the  exit  criteria  for  each 
low-rate  initial  production  lot  (1)  to  maintain  visibility  of  aircraft 
performance  as  production  rates  are  accelerated  and  (2)  ensure  that 
adequate  progress  is  being  made  to  fully  demonstrate  the  aircraft’s 
capabilities.  We  believe  the  restructured  program  should  maintain  the 
integrity  of  the  prior  exit  criteria. 


Estimated  Costs 
Appear  Optimistic 


Cost  growth  and  schedule  delays  are  among  the  most  prevalent,  oldest, 
and  most  visible  problems  associated  with  weapon  systems.  Our  weapon 
system  reviews  over  a  15-year  period  indicate  that  it  takes  longer  and  costs 
more  to  develop  and  produce  weapons  than  the  estimates  on  which  the 
programs  were  initially  approved.^  Program  cost  increases  on  the  order  of 
20  to  40  percent  have  been  common  on  major  weapon  programs,  as  have 
schedule  delays  of  over  2  years. 

Our  review  of  the  Air  Force’s  restructuring  plan  for  the  F-22  program 
indicates  that  the  projected  costs  are  optimistic.  The  planned  reductions  in 
F-22  production  unit  costs  are  greater  than  achieved  on  prior  fighter 
programs,  and  the  initiatives  to  reduce  the  production  costs  are  not  fully 
developed. 


Cost  Reduction  Initiatives  jet  reported  that  projected  costs  for  the  F-22  grew  because  (1)  making  the 

first  three  of  nine  development  aircraft  was  taking  substantially  more 


^Exit  criteria  serve  as  gates  that,  when  successfully  passed  or  exited,  demonstrate  that  the  program  is 
on  track  to  achieve  its  final  program  goals  and  should  be  allowed  to  continue  with  additional  activities 
within  an  acquisition  phase  or  be  considered  for  continuation  into  the  next  acquisition  phase. 

^Weapons  Acquisition:  A  Rare  Opportunity  for  Lasting  Change  (GAO/NSIAD-93-15,  Dec.  1992). 
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labor  than  planned,  (2)  the  flight  test  program  did  not  allow  enough  time 
for  solving  problems  likely  to  be  identified  in  avionics  tests,  (3)  avionics 
integration  was  expected  to  take  more  time  than  first  thought  due  to  slips 
in  the  baseline  schedule  and  loss  of  experienced  software  personnel,  and 
(4)  the  number  of  engineering  changes  on  the  engine  was  expected  to 
increase  over  earlier  projections. 

JET  also  evaluated  the  cost  impact  on  the  production  aircraft  that  could 
occur  because  the  cost  of  the  first  three  development  aircraft  was 
increasing  above  projections  and  the  test  program  needed  to  be  extended. 
As  a  result  of  these  changes,  production  would  have  to  begin  later  and  at  a 
slower  pace,  and  the  cost  of  production  aircraft  would  reflect  the 
increased  costs  of  the  development  aircraft,  jet  concluded  that  cost 
growth  of  about  $13  billion  in  the  production  program  (from  $48  billion  to 
$61  billion)  was  possible  unless  offset  by  various  cost  reduction  actions 
identified  as  tier  I  and  tier  II  initiatives,  jet’s  recommendations  have  been 
endorsed  by  the  Air  Force  and  essentially  approved  by  the  Under 
Secretary  of  Defense  for  Acquisition  and  Technology,  jet’s 
recommendations  are  listed  in  appendix  I. 

JET  concluded  that  savings  of  $6.6  billion  in  production  costs  could  be 
achieved  through  the  tier  I  initiatives.  Although  these  techniques  have  the 
potential  to  reduce  costs,  the  amount  of  savings  that  can  be  achieved  from 
each  will  not  be  known  until  the  initiatives  are  more  specifically  defined 
and  production  contracts  are  negotiated  for  F-22s.  The  tier  I  initiatives 
were  those  defined  by  jet  in  some  detail,  as  shown  in  table  1. 


Table  1 :  Tier  I  Initiatives  and  Estimated 
Cost  Savings 

Dollars  in  billions 

Description 

Savings 

Manage  subcontracts  and  material  more  aggressively 

$0.5 

Initiate  multiyear  procurement  with  approval  of  full-rate 
production 

2.2 

Reduce  warranty  cost 

1.0 

Initiate  producibllity  enhancements 

2.9 

Total 

$6.6 

Tier  II  initiatives  were  less  defined  and  were  expected  to  provide  an 
additional  $6.6  billion  in  savings.  Examples  given  of  additional  initiatives 
include  (1)  corporate  consolidation  opportunities:  (2)  full  contractor  depot 
support;  and  (3)  others,  including  foreign  military  sales,  and  efficiencies  in 
dealing  with  out-of-production  parts. 
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Planned  Reductions  in 
Production  Cost 


Based  on  prior  fighter  aircraft  programs’  experience,  we  are  skeptical  the 
Air  Force  can  achieve  production  cost  reductions  of  $13  billion.  The 
planned  reductions  in  F-22  production  unit  costs  are  greater  than  have 
been  experienced  by  prior  fighter  programs.  Our  comparison  of  the 
planned  reductions  in  F-22  production  unit  costs  with  the  historical  unit 
costs  of  the  F-15,  F-16,  and  F-18  programs  indicates  that  the  projected 
reduction  in  the  unit  cost  of  the  F-22  exceeds  the  reductions  that  have 
been  achieved  on  these  other  programs. 

The  Air  Force  plans  to  acquire  the  first  full-rate  production  lot  of  aircraft 
(the  71st  through  the  1 18th  aircraft)  at  an  average  unit  cost  of  about 
18  percent  of  the  cost  of  the  first  lot  of  lrip  aircraft.  Prior  programs,  such 
as  the  F-16,  have  taken  advantage  of  multiyear  procurement  and  other 
techniques  similar  to  those  proposed  for  the  F-22  program  and  have 
achieved  significant  reductions.  However,  these  reductions  were  not  of  the 
magnitude  projected  for  the  F-22.  For  example,  the  average  unit  cost  of  the 
first  full-rate  lot  of  F-18s  was  about  31  percent  of  the  cost  of  the  first  lrip 
lot. 

Figure  1  compares  the  projected  change  in  F-22  unit  procurement  cost  to 
the  actual  changes  in  unit  procurement  cost  of  the  F-15,  F-16,  and  F-18  and 
plots  the  average  procurement  cost  for  each  succeeding  production  lot  of 
each  aircraft.  None  of  the  other  programs  achieved  the  degree  of  unit  cost 
reductions  projected  for  the  F-22.  DOD  officials  said  F-22  unit  cost 
reductions  are  a  result  of  production  cost  reduction  business  plans  for  the 
tier  I  and  tier  II  initiatives.  Air  Force  officials  noted  that  an  important 
factor  is  that  no  configuration  changes,  except  for  safety-of-flight  changes, 
are  to  be  made  during  lrip  of  the  first  70  aircraft.  However,  by  not  making 
configuration  changes  in  the  first  70  aircraft,  the  likelihood  for  cost  growth 
in  the  first  full-rate  production  lot  may  increase  when  the  changes  are 
made. 
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Figure  1 :  Change  in  Average  Unit  Production  Costs  Between  First  and  Succeeding  Production  Aircraft  Lots 


Percent  of  first  iot  cost 


<C>  Average  unit  cost  of  first  f  uil-rate  lot  as  a  percentage  of  first  LRIP  lot. 

Source;  DOD  Selected  Acquisition  Reports. 

Cost  Reduction  Initiatives  jet’s  tier  I  and  tier  II  initiatives  primarily  consist  of  techniques  that  have 
Still  Being  Developed  been  used  on  prior  programs.  Subsequent  to  jet’s  report,  the  Assistant 

Secretary  of  the  Air  Force  for  Acquisition  chartered  a  team  to  better  define 
jet’s  initiatives.  The  team’s  findings  are  not  scheduled  to  be  finalized  until 
the  fall  of  1997.  Considerably  more  information  about  the  initiatives  and 
their  incorporation  into  a  production  contract  is  necessary  before  it  can  be 
determined  whether  the  initiatives  will  produce  the  desired  outcome. 
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Multiyear  Procurement 


Reducing  Warranty  Cost 


Depot  Maintenance 


Potential  Overlap  of  Estimated 
Savings 


Even  though  tier  I  and  tier  II  initiatives  have  not  been  fully  defined,  our 
prior  work,  a  DOD  Cost  Analysis  Improvement  Group  (caig)  report,  and 
recent  developments  allow  us  to  make  observations  about  the  initiatives 
dealing  with  multiyear  procurement,  warranty  costs,  depot  maintenance, 
subcontract  management,  and  producibility  enhancements.  In  addition, 
our  discussions  with  Air  Force  officials  confirmed  that  tradeoffs  in  F-22 
performance  were  considered  but  not  recommended  by  jet. 

JET  attributed  about  $2.9  billion  in  savings  to  multiyear  procurement,^  but 
CAIG  estimated  $2.4  billion  savings  based  on  the  recent  experience  of  the 
C-17  program.  Multiyear  procurement  has  been  a  source  of  significant 
savings  in  the  past  and  could  provide  savings  for  the  F-22  program.  A 
major  portion  of  the  savings  from  multiyear  procurement  typically  results 
from  the  lower  prices  on  economic  purchase  orders  from  vendors  or 
subcontractors. 

The  amount  of  cost  reductions  that  can  be  achieved  by  implementing  a 
different  warranty  clause  is  unclear,  jet  concluded  that  savings  of  $1 
billion  could  be  achieved.  However,  the  contractors’  more  recent  estimate 
of  the  savings  available  is  about  $0.7  billion,  which  seems  more  realistic. 
By  applying  the  average  cost  of  warranties  we  identified  in  past  work, 
about  0.87  percent  of  the  total  contract  value,®  we  believe  that  about 
$400  million  to  $500  million  in  costs  could  be  avoided  if  the  Wcirranty 
clause  were  eliminated.  Air  Force  officials  explained  that  they  do  not 
intend  to  eliminate  the  warranty  and  have  provided  about  $200  million  in 
the  estimate  of  the  cost  for  a  warranty  that  is  more  limited,  but  complies 
with  statutes.  Thus,  the  projected  $1  billion  in  savings  is  not  likely  to 
occur. 

JET  envisioned  that,  by  allowing  for  full  depot  maintenance  by  the 
contractor,  DOD  could  avoid  $2.5  billion  in  acquisition  costs.  According  to 
Air  Force  officials,  contractor  depot  maintenance  is  no  longer  being 
considered  a  cost  reduction  initiative.  Therefore,  the  potential  for  the  jet 
initiatives  to  achieve  $13  billion  in  cost  reductions  may  be  more  difficult. 

Initiatives  regarding  multiyear  procurement,  more  aggressive  management 
of  subcontracts,  and  producibility  enhancements  all  have  applicability  to 
subcontractors.  A  significant  portion  of  multiyear  procurement  savings  on 
other  programs  have  been  achieved  by  acquiring  products  from 


^Multiyear  procurement,  when  authorized,  uses  one  contract  to  procure  up  to  5  years  of  requirements 
for  a  major  weapon  system  and  its  components. 

^Weapons  Acquisition:  Warranty  Law  Should  Be  Repealed  (GAO/NSIAD-96-88,  June  28, 1996). 
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subcontractors  on  an  economic  order  quantity  basis.  Further,  to  achieve 
savings  of  the  magnitude  projected,  producibility  enhancements  will 
involve  subcontractors.  More  aggressive  management  of  subcontracts 
overlaps  both  of  these  initiatives.  Because  the  initiatives  were  not  well 
defined  by  jet,  we  are  uncertain  whether  the  identified  savings  are 
counted  more  than  once. 

Reducing  Aircraft  Performance  Although  jet  members  told  us  they  considered  performance  reductions  in 

their  study  as  a  means  of  reducing  costs,  no  such  reductions  were  made. 
The  Defense  Science  Board,  in  a  1995  review  of  the  concurrency  and  risk 
in  the  F-22  program  concluded  that  such  reductions  may  be  appropriate  if 
problems  are  encountered  in  the  program.  The  Board  concluded  in 
April  1995  that  the  “. . .  best  approach  to  handling  problems  that  do  arise  is 
to  seriously  consider  accepting  some  reduced  F-22  performance,  slip  in 
the  schedule,  or  some  combination  of  both.”  The  Board  also  stated  that 
F-22  performance  in  many  areas,  if  it  fell  short  of  that  specified,  would  still 
represent  a  major  increase  in  military  capability,  and  that  rigid  adherence 
to  the  current  specifications  and  goals  would  generally  be  unproductive 
and  very  costly. 


The  restructuring  plan  recognized  substantial  cost  growth  in  the  LRIP  phase 
of  the  program.  The  plan  also  projected  substantial  cost  reductions  in  the 
full-rate  production  phase  of  the  program  that  will  offset  the  earlier  cost 
growth  and  investment  in  cost  reduction  techniques. 

Fiscal  Year  2003 


Cost  Growth  in  LRIP  As  a  result  of  restructuring,  the  average  estimated  unit  cost  of  LRIP  aircraft 

increased  from  $142.6  million  to  $200.8  million,  or  about  40  percent.  Table 
2  shows  a  reduction  in  the  number  of  LRIP  aircraft  from  76  to  70  aircraft 
but  an  increase  of  $3.2  billion  in  the  estimated  cost  of  LRIP.  Before 
restructuring,  the  Air  Force  estimated  that  76  lrip  aircraft  could  be 
purchased  for  $10.8  billion.  With  the  February  1997  restructured  program, 
the  Air  Force  estimated  that  70  aircraft  could  be  purchased  at  $14  billion. 
The  restructuring  plan  eliminated  the  preproduction  aircraft  and  changed 
the  production  plan  for  lrip,  as  shown  in  table  2. 


Benefits  of  Initiatives 
Are  Not  Planned  to  Be 
Realized  Until  After 
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Table  2:  Planned  LRIP  Aircraft 
Quantities  and  Costs  Before  and  After 
Restructuring 


Then-year  dollars  in  millions 

Fiscal  year 

LRIP 

LRIP 

Unit 

Estimate 

1999  2000 

2001 

2002 

2003 

total 

cost 

cost 

Before 

restructure 

4 

12 

24 

36 

0 

76 

$10,837 

$142.6 

After 

restructure 

2 

6 

12 

20 

30 

70 

14,057 

200.8 

Difference 

-2 

-6 

-12 

-16 

30 

-6 

$3,220 

$58.2 

Cost  Reductions  Planned 
for  Full-Rate  Production 
Phase 


Some  savings  from  tier  I  and  tier  II  initiatives  are  expected  to  begin  during 
LRIP.  However,  the  costs  of  investment  to  implement  the  initiatives  are 
expected  to  exceed  any  savings  achieved  during  LRIP.  Most  savings  are  not 
planned  to  be  achieved  until  full-rate  production  that  is  scheduled  to  begin 
in  2004.  As  shown  in  table  3,  the  unit  price  of  LRIP  F-22s  before 
restructuring  was  $142.6  million,  and  the  unit  price  of  full-rate  aircraft  was 
$102.8  million — a  decrease  of  27.9  percent.  After  restructuring  the  program 
and  implementing  the  jet  initiatives,  the  unit  price  of  LRIP  aircraft  is 
projected  to  be  $200.8  million,  and  the  unit  price  of  full-rate  aircraft  is 
projected  to  be  $92.4  million — a  decrease  of  54  percent.  Therefore,  to 
achieve  the  overall  cost  avoidance  projected  by  jet,  the  unit  cost  of 
full-rate  aircraft  must  be  reduced  by  54  percent  from  the  unit  cost  of  the 
LRIP  aircreift  instead  of  by  27.9  percent,  as  projected  before  the  program 
restructure. 


Table  3:  Comparison  of  DOD’s 
Projected  Unit  Prices  Before  and  After 
Restructuring 


Production 

-  Unit  orice 

Low-rate _ PuM-ratB  decreasefrom 

Estimates  Units  Unit  cost  Units  Unit  cost  LRIP  to  full-rate 


Before  restructuring 

76 

$142.6 

362 

$102.8 

27.9% 

Restructured  without 
initiatives 

70 

$200.3 

368 

$128.2 

36.0% 

Restructured  with  initiatives 

70 

$200.8 

368 

$  92.4 

54.0% 

In  December  1996,  the  Air  Force,  Lockheed,  and  Pratt  &  Whitney  entered 
into  a  memorandum  of  agreement  that  summarizes  their  intentions  for 
implementing  the  restructured  program.  The  memorandum  of  agreement 
describes  a  contract  strategy  requiring  negotiation  of  a  target  price  curve 
that  is  to  permit  production  of  438  F-22s  at  a  cost  of  about  $48  billion.  In 
February  1997,  the  Under  Secretary  of  Defense  for  Acquisition  and 
Technology,  in  approving  the  Air  Force’s  plan  to  restructure  the  F-22 
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program,  required  the  Air  Force  to  clarify  the  contractual  implications  of 
the  memorandum  of  understanding. 

According  to  DOD  officials,  six  factors  are  critical  to  maintaining  the 
production  cost  at  the  planned  level: 

•  maintaining  stable  funding  throughout  the  production  phase  of  the 
program, 

•  procuring  a  total  of  438  aircraft  in  13  lots; 

•  attaining  a  production  rate  of  48  aircraft  per  year  in  fiscal  year  2004; 

•  achieving  cost  savings  at  the  levels  estimated  by  jet; 

•  maintaining  a  single  configuration  for  aircraft  produced  through  the  lrip 
program,  except  for  changes  for  safety  reasons;  and 

•  negotiating  a  target  price  curve  that  is  tied  to  a  production  lot  profile  as 
recommended  by  JET  and  endorsed  by  the  Air  Force. 

In  view  of  the  announced  reduction  of  F-22  production  quantities  from 
438  to  339,  it  appears  that  the  contract  strategy  may  require  change. 

CAIG  also  evaluated  the  cost  of  the  F-22  program  and  concluded  in 
March  1997  that  the  production  cost  could  approach  $64.4  billion — about 
$3  billion  higher  than  the  Air  Force’s  estimate.  However,  CAiG  was  not 
convinced  that  the  jET-identified  initiatives  would  achieve  $13  billion  in 
cost  savings  and  accepted  as  valid  only  an  estimated  $2.4  billion  of 
savings — those  associated  with  multiyear  procurement.  That  savings 
lowered  caig’s  estimate  to  about  $62  billion  for  production  compared  with 
the  Air  Force’s  $48  billion  estimated  cost  after  considering  the 
jET-identified  initiatives. 


Revised  Exit  Criteria 
Resulted  From 
Restructuring 


The  program  exit  criteria  that  were  required  to  be  met  before  awarding 
contracts  for  F-22  production  aircraft  have  been  revised  in  the 
restructured  program.  In  1991,  when  approving  the  F-22  program  to  begin 
the  engineering  and  manufacturing  development  phase,  the  Under 
Secretary  of  Defense  for  Acquisition  required  the  Air  Force  to  establish 
exit  criteria  that  needed  to  be  met  before  awarding  production  contracts. 
The  Air  Force  established  exit  criteria  for  each  lot  of  lrip  aircraft  and  the 
first  lot  of  full-rate  production  aircraft.  As  part  of  the  program 
restructuring,  the  Air  Force  revised  these  criteria,  increasing  the  emphasis 
on  avionics  but  removing  criteria  concerning  aircraft  performance. 
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In  the  previous  criteria,  aircraft  performance  parameters  for  combat 
radius,  maneuverability,  and  supercruise  were  required  to  be  validated  by 
analysis,  test,  or  demonstration  before  contracts  for  lot  1  and  subsequent 
production  lots  could  be  awarded.  Air  Force  and  DOD  officials  noted  that 
key  aircraft  performance  parameters  are  routinely  reported  in  periodic  Air 
Force  and  DOD  reports,  such  as  the  Selected  Acquisition  Report,  to 
acquisition  and  other  executives.  Accordingly,  the  officials  said  that 
reporting  the  performance  parameters  as  part  of  the  exit  criteria  is 
duplicative  and  not  encouraged  by  dod  directives. 

The  revised  exit  criteria  include  no  specific  requirements  regarding 
aircraft  performance  as  the  program  advances  from  one  lrip  lot  to  the 
next.  Although  we  recognize  that  reporting  the  key  performance 
parameters  occurs  through  other  reports,  we  believe  aircraft  performance 
should  be  included  as  exit  criteria  because  analysis  and  demonstration  of 
aircraft  performance  are  important  factors  in  determining  whether  to 
proceed  to  the  next  production  lot.  We  believe  exit  criteria  for  aircraft 
performance  equivalent  to  those  established  when  the  program  entered 
engineering  and  manufacturing  development  are  still  valid  and  should  be 
retained  in  the  restructured  program. 


Recommendations 


Since  the  Air  Force  plans  to  request  approval  for  the  first  production  lot  of 
F-22  aircraft  in  fiscal  year  1999,  we  recommend  that  the  Secretary  of 
Defense,  as  part  of  the  budget  justification  for  fiscal  year  1999,  provide 
financial  plans  and  cost  estimates  that  clearly  identify  the  basis  for  cost 
savings  initiatives  that  have  been  approved  for  the  program  at  that  time. 
Because  of  the  potential  for  cost  growth  in  the  F-22  program,  we  also 
recommend  that  the  Secretary  reconsider  the  potential  savings  that  can  be 
achieved  by  reducing  the  performance  requirements  of  the  F-22,  as 
previously  suggested  by  the  Defense  Science  Board.  Finally,  we 
recommend  that  the  Under  Secretary  of  Defense  for  Acquisition  and 
Technology  reevaluate  the  exit  criteria  for  the  F-22  to  ensure  that  the 
integrity  of  the  prior  criteria  are  maintained. 


Agency  Comments 
and  Our  Evaluation 


In  commenting  on  a  draft  of  this  report,  dod  indicated  that  our 
recommendations  were  appropriate  areas  for  consideration  due  to  the 
restructuring  and  reduction  of  the  F-22  program,  as  called  for  in  the 
May  1997  Quadrennial  Defense  Review,  dod  acknowledged  the  importance 
of  updating  the  production  cost  estimate  and  incorporating  information 
from  restructuring  activities  and  program  reductions  into  the  budget 
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process  as  quickly  as  practical,  dod  also  stated  that  it  would  make  every 
effort  to  complete  the  detailed  F-22  costing  data  in  time  to  influence  the 
fiscal  year  1999  President’s  budget.  In  addition,  DOD  said  that  it  does  not 
believe  that  a  substantial  reduction  in  F-22  required  performance  is 
currently  justified,  but  it  indicated  that  cost-effectiveness  analyses  will  be 
done  to  determine  whether  it  is  appropriate  to  lower  requirements  that  are 
not  met  during  testing,  dod  acknowledged  that  certain  aircraft 
performance  measures  had  been  deleted  from  exit  criteria.  However,  dod 
stated  that  the  exit  criteria  had  been  simplified  and  reordered  to  conform 
to  the  restructured  schedule  but  not  at  the  expense  of  either  the  quality  or 
difficulty  of  the  events  and  performance  levels  that  determine  whether  the 
program  should  be  allowed  to  proceed  to  the  next  acquisition  phase. 
Moreover,  dod  indicated  that  the  new  criteria  related  to  the  demonstration 
of  avionics  maturity  had  been  added. 

After  considering  dod’s  comments,  we  believe  our  recommendation  is  still 
valid  because  the  original  exit  criteria  required  intermediate  validation  of 
the  aircraft  performance  parameters  before  award  of  each  lrip  lot, 
whereas  the  revised  exit  criteria  deleted  the  intermediate  validation 
requirement  and  only  considered  the  comparable  requirement  to  enter 
full-rate  production.  However,  a  number  of  aircraft  will  have  already  been 
procured  by  that  time,  dod’s  comments  are  reprinted  in  appendix  II.  dod 
also  provided  technical  corrections  to  the  report,  which  we  have 
incorporated  where  appropriate. 


Scope  and 
Methodology 


We  reviewed  and  analyzed  available  reports,  briefings,  documents,  and 
records  and  interviewed  officials  at  the  F-22  program  office, 
Wright-Patterson  Air  Force  Base,  Ohio;  Air  Force  Headquarters,  and  the 
Office  of  the  Under  Secretary  of  Defense  for  Acquisition  and  Technology, 
Washington,  D.C.  To  gauge  the  overall  viability  of  the  Air  Force’s 
restructuring  plans,  we  compared  the  unit  costs  of  the  F-22  before  the 
restructuring  with  the  unit  costs  after  restructuring.  We  also  compared  the 
unit  cost  reductions  planned  for  the  F-22  with  the  historical  cost 
reductions  experienced  on  the  F-15,  F-16,  and  F-18  fighter  aircraft 
programs.  We  also  used  our  prior  reports  and  those  of  other  organizations 
to  provide  a  historical  and  contextual  framework  for  evaluating  the  Air 
Force’s  plemned  cost  reduction  initiatives.  We  reviewed  a  Defense  Science 
Board  report  regarding  concurrency  and  risk  in  the  F-22  program  and 
reports  on  F-22  restructuring  by  CAIG  and  the  Congressional  Budget  Office. 
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We  performed  our  review  between  March  and  May  1997  in  accordance 
with  generally  accepted  government  auditing  standards. 


As  agreed  with  your  office,  unless  you  publicly  announce  its  contents 
ecirlier,  we  plan  no  further  distribution  of  this  report  until  5  days  from  its 
issue  date.  At  that  time,  we  will  send  copies  of  this  report  to  the  Chairmen 
and  Ranking  Minority  Members  of  appropriate  congressional  coimnittees; 
the  Secretaries  of  Defense  and  the  Air  Force;  the  Director,  Office  of 
Management  and  Budget:  and  other  interested  parties. 

Please  contact  me  at  (202)  512-4841  if  you  or  your  staff  have  any  questions 
concerning  this  report.  Major  contributors  to  this  report  are  listed  in 
appendix  III. 

Sincerely  yours. 


Louis  J.  Rodrigues 

Director,  Defense  Acquisitions  Issues 
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Recommendations  of  the  Joint  Estimate 
Team 


The  Joint  Estimate  Team  recommended  that  the  Air  Force 

•  slow  the  manufacturing  of  development  aircraft  to  ensure  an  efficient 
transition  from  development  to  low-rate  initial  production: 

•  increase  the  time  available  for  avionics  software  development  and 
integration: 

•  develop  a  more  effective  avionics  ground  test  capability: 

•  implement  revised  avionics  flight  test  processes: 

•  extend  the  flight  test  schedule  by  9  months  to  allow  additional  time  to 
identify,  analyze,  and  resolve  avionics  anomalies: 

•  extend  the  development  program  by  12  months  to  accommodate  a 
9-month  flight  test  extension: 

•  finish  development  of  a  baseline  capability  before  beginning  dedicated 
initial  operational  test  and  evaluation: 

•  delete  the  plans  to  produce  preproduction  aircraft  and  conduct  dedicated 
initial  operational  test  and  evaluation  with  two  refurbished  development 
aircraft  and  the  first  two  production  aircraft: 

•  delay  initiation  of  full-rate  production  by  10  months: 

•  slow  the  rates  of  low-rate  initial  production  to  make  funds  available  for 
development  activities  and  increase  system  maturity:  and 

•  deliver  a  mature  avionics  capability  before  initial  operational  capability 
planned  for  November  2004. 
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Comments  From  the  Department  of  Defense 


OFFICE  OF  THE  UNDER  SECRETARY  OF  DEFENSE 

3000  DEFENSE  PENTAGON 
WASHINGTON  DC  20301-3000 

2  9  may  1357 

Mr.  Louis  J.  Rodrigues 
Director,  Defense  Acquisitions  Issues 
National  Security  and  International 
Affairs  Division 
U.S.  General  Accounting  Office 
Washington,  D.C.  20548 


Dear  Mr.  Rodrigues; 

This  is  the  Department  of  Defense  (DoD)  response  to  the  General  Accounting 
Office  (GAO)  draft  report,  ‘TACTICAL  AIRCRAFT;  Restructuring  of  the  Air  Force 
F-22  Fighter  Program,’’  dated  May  15, 1997  (GAO  Code  707246),  OSD  Case  1360.  The 
three  recommendations  made  by  the  GAO  are  appropriate  areas  for  consideration  due  to 
the  recent  restructuring  of  the  F-22  program. 

The  Air  Force  and  its  contractor  team  are  currently  implementing  the  details  of 
the  Production  Cost  Reduction  Business  Plans  which  will  provide  the  basis  for  the 
expected  cost  reductions  identified  by  the  Joint  Estimating  Team  (JET)  last  year.  This 
activity  must  now  account  for  the  recently  announced  Quadrennial  Defense  Review 
decision  to  reduce  the  total  buy,  ramp  rate  and  maximum  production  rate  for  F-22 
aircraft.  We  expect  this  activity,  and  the  parallel  efforts  by  both  the  Air  Force  and  the 
OSD  Cost  Analysis  Improvement  Group  to  update  the  production  cost  estimate,  to  be 
completed  by  early  1998.  The  DoD  agrees  that  it  is  important  to  incorporate  this 
information  into  the  budget  formulation  process  as  quickly  as  practical. 

The  DoD  and  the  Air  Force  have  continually  assessed  the  cost-effectiveness  of 
F-22  requirements.  Each  of  the  F-22’s  revolutionary  capabilities  has  “bought  its  way 
onto  the  aircraft,”  There  have  been  incidences  where  the  Air  Force  and  DoD  have 
assessed  the  potential  cost  impact  of  some  of  the  performance  areas,  and  have  relaxed 
requirements  to  eliminate  the  potential  for  undue  cost.  The  performance  requirements 
were  reviewed  again  during  the  JET  process,  and  the  team  determined  that  a  major 
reduction  in  performance  was  not  worth  the  marginal  savings.  Although  the  DoD  does 
not  believe  that  a  substantive  reduction  in  required  performance  is  currently  justified,  we 
agree  with  the  need  to  maintain  a  broad  review  of  potential  options  to  maintain  cost 
control  of  the  F-22  program.  In  particular,  the  Secretar>^  of  Defense  stated  in  forwarding 
the  CAIG  Independent  Cost  Estimate  on  F-22  to  the  Congress  in  February  1997:“... 
consistent  with  the  DoD  Cost  As  an  Independent  Variable  approach,  DoD  will  continue 
to  assess  the  need  to  change  program  content  -  quantity  and/or  quality  -  to  keep  the  F-22 
program  both  stable  and  affordable.” 


ACQUiSITiON  AND 
TECHNOLOGY 
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The  recent  streamlining  of  the  exit  criteria  for  the  F-22  has  not  resulted  in  a 
relaxation  of  the  requirements  that  the  program  must  meet  before  proceeding  from  one 
phase  to  the  next.  The  Under  Secretary  of  Defense  (Acquisition  and  Technology) 
approved  streamlined  exit  criteria  to  remove  redundancies  with  the  Acquisition  Program 
Baseline  (APB),  This  is  consistent  with  the  guidance  contained  in  DoD  Instruction 
5000.2-R,  dated  March  15. 1996.  Key  Performance  Parameters  (KPPs)  have  been 
removed  from  the  exit  criteria,  but  remain  in  the  APB,  which  is  the  principal  “contract” 
between  the  USD(A&T)  and  the  Program  Manager  on  performance,  cost,  and  schedule. 
The  deletion  of  these  performance  measures  from  the  exit  criteria  has  not  lessened  the 
DoD  oversight.  The  APB  demands  thorough  oversight  of  performance,  requiring  the 
Program  Manager  to  immediately  report  any  performance  shortfalls.  Additional  exit 
criteria  have  been  added  in  the  area  of  integrated  avionics  maturity.  The  revised  F-22  exit 
criteria  retain  both  the  quality  and  quantity  to  assure  that  the  F-22  must  show  appropriate 
progress  toward  meeting  the  performance  parameters  in  the  APB  before  proceeding  to  the 
next  program  milestone.  The  DoD  does  not  believe  there  is  a  need  to  further  reevaluate 
the  exit  criteria  for  the  F-22. 

Attachment  1  addresses  the  GAO  recommendations  in  more  depth,  and 
Attachment  2  contains  some  detailed  DoD  comments  on  the  report.  The  DoD  appreciates 
the  opportunity  to  comment  on  the  draft  report. 

Sincerely, 


George  R.  Schneiter 
Director 

Strategic  and  Tactical  Systems 
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GAO  DRAFT  REPORT  DATED  MAY  1 5, 1997 
(GAO  Code  707246),  OSD  CASE  1360 

“TACTICAL  AIRCRAFT:  Restructuring  of  the  Air  Force  F-22  Fighter  Program” 
DEPARTMENT  OF  DEFENSE  COMMENTS 

RECOMMENDATIONS 


Recommendation  li  Since  the  Air  Force  plans  to  request  approval  of  the  first 
production  lot  of  F-22  aircraft  in  Fiscal  Year  1999,  the  GAO  recommended  that  the 
Secretary  of  Defense,  as  a  part  of  the  budget  justification  for  FY1999,  provide  financial 
Now  on  p.  1 1 .  and  cost  estimates  that  clearly  identify  the  basis  for  cost  savings  initiatives  that 

have  been  approved  for  the  program  at  that  time.  (p.  2 1/GAO  Draft  Report) 

DoD  Response:  Partially  Concur.  The  DoD  will  make  ever>'  effort  to  complete 

the  detailed  F-22  costing  data  and  cost  savings  rationale  in  time  to  influence  the  FY99 
President’s  Budget.  If  this  cannot  be  achieved,  the  data  will  be  incorporated  into  the  DoD 
budget  process  as  soon  as  practical.  The  Air  Force  and  its  contractor  team  are  currently 
working  to  implement  the  details  of  the  production  program  cost  reduction  business  plans 
for  each  of  the  so-called  Tier  1  and  Tier  2  initiatives  identified  by  the  Joint  Estimating 
Team.  These  plans  will  identify  the  basis  for  the  cost  savings  to  be  achieved  by  each 
initiative,  and  the  savings  will  be  incorporated  into  the  Target  Price  Curve  (TPC).  The 
Quadrennial  Defense  Review  decision  may  affect  the  work  accomplished  thus  far  on 
these  cost  reduction  efforts  because  it  results  in  a  decrease  in  the  total  quantity,  maximum 
production  rate,  and  ramp  rate  for  the  F-22  production  program.  The  Air  Force  plans  to 
negotiate  a  TPC  by  the  end  of  1997  that  will  incorporate  the  planned  cost  savings.  In 
parallel  with  these  efforts,  both  the  Air  Force  and  the  OSD  Cost  Analysis  Improvement 
Group  are  working  to  update  their  production  cost  estimates.  The  DoD  plan  is  to 
incorporate  these  data  in  the  FY99  President’s  budget  submission,  if  possible,  and 
provide  the  normal  documentation  in  support  of  the  budget  submission.  Otherwise,  these 
out-year  production  budget  data  are  expected  to  be  available  to  support  FY99 
congressional  testimony,  as  well  as  formulation  of  the  FYOO  budget  and  associated  FYOO- 
05  FYDP.  The  timing  of  these  activities  is  satisfactory,  since  the  significant  differences  in 
the  original  Air  Force  and  CAIG  production  cost  estimates  did  not  occur  until  the  post- 
FY03  time  period. 

Recommendation  2:  Because  of  the  potential  for  cost  growth  in  the  F-22  program,  the 
GAO  also  recommended  that  the  Secretar>'  of  Defense  reconsider  the  potential  savings 
Now  on  pp.  1 1  and  1 2 .  that  can  be  achieved  by  reducing  the  performance  requirements  of  the  F-22,  as  previously 

suggested  by  the  Defense  Science  Board.  (p.21/GAO  Draft  Report) 
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DoD  Response:  Partially  Concur.  As  a  part  of  its  “cost  as  an  independent 

variable”  efforts,  the  DoD  will  continue  to  examine  the  potential  for  achieving  cost 
savings  through  performance  trade-offs  on  weapons  systems.  The  DoD  and  the  Air  Force 
have  consistently  analyzed  the  F-22  requirements  with  regard  to  cost.  Each  of  the  F-22’s 
revolutionary  capabilities  has  “bought  its  way  onto  the  aircraft.”  There  have  been 
incidences  where  the  Air  Force  and  DoD  have  assessed  the  potential  cost  impact  of  some 
of  the  performance  areas,  and  have  relaxed  requirements  to  eliminate  the  potential  for 
undue  cost  to  occur.  The  attached  figure  highlights  some  of  the  trades  that  have  already 
been  accomplished  on  the  program.  The  performance  requirements  were  reviewed  again 
during  the  Joint  Estimating  Team  process,  and  the  team  determined  that  a  major 
reduction  in  performance  was  not  worth  the  marginal  savings.  While  further  reduction  in 
performance  is  always  an  option,  the  DoD  does  not  consider  that  approach  as  the  primary 
path  to  ftiture  cost  reduction  in  the  F-22  program.  Since  the  vehicle  critical  design 
review  has  been  completed  for  F-22,  and  the  configuration  is  stable,  there  is  less 
opportunity  to  effect  significant  cost  reduction  through  reduced  performance 
requirements  at  this  time.  Nevertheless,  there  may  be  potential  for  identifying  means  to 
achieve  further  cost  avoidance  during  the  upcoming  flight  test  phase  of  the  program.  If  a 
requirement  is  not  met  during  testing,  cost-effectiveness  analyses  will  be  used  to 
determine  whether  it  is  appropriate  to  lower  that  requirement  in  lieu  of  expending 
additional  resources. 


Recommendation  3:  The  GAO  further  recommended  that  the  Secretary  of  Defense 
reevaluate  the  exit  criteria  for  the  F-22  to  ensure  that  the  integrity  of  the  prior  criteria  are 
maintained,  (p.2 1  /GAO  Draft  Report) 

DoD  Response;  Nonconcur.  The  DoD  has  not  relaxed  the  exit  criteria  for  the 
F-22  even  though  the  performance  parameters  in  the  original  exit  criteria  have  been 
removed.  The  exit  criteria  for  the  F-22  have  been  simplified  and  reordered  to  conform  to 
the  restructured  schedule,  but  not  at  the  expense  of  either  the  quality  or  difficulty  of  the 
events  and  performance  levels  that  determine  whether  the  program  should  be  allowed  to 
proceed  to  the  next  acquisition  phase.  Additional  criteria  related  to  demonstration  of 
avionics  maturity  have  been  incorporated.  At  the  time  the  original  exit  criteria  were 
formulated  for  the  Milestone  11  decision  in  1 991 ,  there  was  redundancy  between  the  exit 
criteria  and  the  Acquisition  Program  Baseline  (APB),  because  the  exit  criteria  repeated 
some  of  the  Key  Performance  Parameters  (KPPs)  fmm  the  APB.  The  DoDI  5000.2-R 
dated  March  15, 1996  (Part  3,  p.3,  paragraph  3.2.3)  states  that  exit  criteria  are  not 
intended  to  repeat  or  usurp  the  performance  parameters  for  the  system  under  development 
contained  in  the  APB.  The  APB  with  its  KPP  thresholds/objeciives  continues  as  the 
principal  binding  “contract”  between  the  Defense  Acquisition  Executive  and  the  Program 
Manager.  The  status  of  these  KPPs  is  reviewed  quarterly  as  part  of  the  Defense 
Acquisition  Executive  Summary'  reporting  requirement. 

Exit  criteria  define  intermediate  progress  that  should  be  achieved  toward  meeting 
the  final  program  performance  specified  in  the  APB.  At  the  Overarching  Integrated 
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Product/Process  Team  review  of  the  restructured  F-22  program  in  Januar>'  1997,  it  was 
requested  that  the  exit  criteria  be  reviewed  to  eliminate  the  redundancy  with  the  APB,  and 
the  criteria  be  realigned  wnth  the  restructured  program  schedule.  During  this  review 
process,  additional  criteria  relating  to  integrated  avionics  maturity  were  added.  A  revised 
set  of  criteria  was  proposed  for  consideration,  and  the  USD(A&T)  approved  them  as  a 
part  of  the  Defense  Acquisition  Board  review  in  February  1997.  These  criteria  are 
sufficiently  quantitative  and  significant  to  determine  whether  the  F-22  program  should  be 
allowed  to  proceed  to  the  next  acquisition  phase.  There  is  no  need  to  further  reevaluate 
the  exit  criteria,  or  to  retain  any  redundancy  between  the  exit  criteria  and  the  APB. 
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